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CRITICISMS OF THE EPIDEMIOLOGIC STUDIES ON ETS AND LUNG CANCER 


Some general criticisms are applicable to the majority 
of the epidemiologic studies on ETS and lung cancer. 

Strength of the association 

• Wynder and Kabat wrote in 1990: 

An association is generally considered weak if • 
the odds ratio is under 3.0 and particularly 
when it is under 2.0, as is the case in the 
relationship of ETS and lung cancer. 

Such a weak association calls for special attention to possible 

sources of bias and confounding. 

Exposure bias 

• Spouses, next-of-kin or friends are sometimes asked to estimate 
the amount of ETS to which they think the subject was exposed. 
This may result in something called "exposure bias" or 
"exposure misclassification." 

• Exposure indices and risk estimates based on this type of 
information may be improper and incorrect. 

• One example of this was reported in the Garfinkel, et al., 
study, published in 1985, which reported relative risks of 
0.83 when the cases answered questions about ETS, 0.77 when 
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the cases' husbands answered, and 3.57 when the cases' children 
answered (a copy of this study may be found in Section A of 
this notebook). 

Reporting bias 

• Another type of bias that may arise is "reporting bias," which 

may result if cases and controls respond differently to 

o 

questions about personal smoking and ETS exposure. 

Publication bias 

• "Publication bias" arises from the apparent failure by 
scientific journals to publish papers reporting negative or 
weakly positive results. If this occurs, the set of published 
investigations may not be truly representative of all the 

3 

studies in the area. 

Confounding factors 

• The studies did not always account for possible confounding 
factors. (This is addressed in more detail in the section in 
this notebook on confounders.) 
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Use of questionnaires 


• All of the epidemiologic studies on the purported association 
between ETS exposure and disease in nonsmokers rely solely upon 
questionnaires about exposure, rather than upon actual exposure 
data. 4 Recent studies indicate that questionnaires are an 
unreliable and inaccurate measure of exposure. 

• Questionnaire responses about exposure vary widely when 
compared with actual measurements of ETS constituents in the 
ambient air. 5 

Histology 

• Lung cancer diagnoses were not always histologically or 
pathologically verified. 1 

• Also, the histological composition, i.e., the type of lung 
cancer, differed among studies (in some studies, all 
histological types were included; in others, some types were 
excluded). 1 
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"Data-dredginq" 


• Investigators often examine numerous subgroups of the study 
population, and may report only those conclusions which fit 
with their hypothesis. 1 (This is sometimes called "data- 
dredging. M ) 

Misclassification 

• If the personal smoking status of subjects is not accurately 
classified, it could result in "misclassification bias." 


• One critic, Peter Lee, contends that the reported "risks" for 
nonsmokers are the result of bias caused by a small number of 
smokers who are reported in the studies as nonsmokers. 6 

Conclusion 


German scientist Karl Uberla discussed some criticisms of 
the ETS-lung cancer studies at a recent scientific symposium in 
Argentina: 


The majority of criteria for a causal connection 
are not fulfilled. There is no consistency, 
there is a weak association, there is no 
specificity, the dose-effect relation can be 
viewed controversially, bias and confounding 
are not adequately excluded, there is no 
intervention study, significance is only present 
under special conditions and the biological 
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plausibility can be judged controversially 


7 


The eminent statistician Nathan Mantel concluded the 

following: 

[I]t is unlikely that any epidemiological study 
has been, or can be, conducted which could 
permit establishing that the risk of lung cancer 
has been raised by passive smoking. Whether 
or not the risk is raised remains to be taken 
as a matter of faith. 


Copies of critical papers, highlighted in yellow for 
useful information and in blue for adverse statments, are found 
at Tabs 1-7. 
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CRITICISMS OF THE HIRAYAMA STUDY 


Numerous criticisms of the Hirayama study have been 
made. 8 ” 21 They include: 

• The age distribution of the sample is not representative of the 
total Japanese population, particularly for women over the 

Q 

age of 40. When a statistical correction is made for this 
bias, the increased relative risk reported by Hirayama 
virtually disappears. 

• The appropriateness of Hirayama's standardization of the data 

by husband's age, rather than by subject's, has been 
9—12 

questioned. When Kilpatrick re-analyzed the data adjusted 

by subject's age, the model used by Hirayama was shown to be 
inappropriate and the reported significantly elevated risk 
associated with husband's smoking was no longer apparent. 

• The Hirayama study was not designed to investigate ETS 
exposure; it is inappropriate to use it to make conclusions 
about the hypothesis of an ETS-lung cancer relationship. 8 

• Errors and internal inconsistencies in the data and in risk 

ratios and confidence intervals have been noted and publicly 

. 13-15 

acknowledged by Hirayama. 
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• The design of the study has been criticized, e.g., use of 

death certificates as evidence for lung cancer is unreliable 8 ? 

autopsy or histology results were available for only 11.5% 

8 16 

(23 of 200) of the cases ' ; use of the smoking status of 

the subject's husband as a surrogate measure for ETS exposure 

8 12 

is not reliable ' ; many possible confounding factors were 

overlooked. 8 ' 17 

It appears that Hirayama has never adequately addressed 
the criticisms; for instance, his 1990 monograph on the study 
persists in presenting the same data analyses that have been 
particularly criticized. In addition, Hirayama has not made his 
original data available for review. 8 ' 19 ' 20 

A bibliography of the criticisms follows. Copies of 
selected papers are given at Tabs 8-20. They are highlighted in 
yellow for useful information and in blue for adverse statements. 
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CRITICISMS OF THE TRICHOPOULOS STUDY 


Regarding the Trichopoulos, et al., study, the following 

criticisms have been made: 

♦ In 1990, Letzel and Uberla evaluated the quality of ETS-lung 
cancer studies. Based on possible sources of bias and other 
problems with study design, they concluded that the 
Trichopoulos, et al. study, in particular, is "methodologically 
unacceptable" and is "a textbook example of how a case-control 
study should not be performed." Furthermore, they reported 
that this study may strongly influence the outcomes of meta¬ 
analyses of the ETS-lung cancer epidemiological studies (e.g., 
when the Trichopoulos study was included in meta-analyses of 

„ all possible case-control study combinations, it appeared in 
330 of the 353 significant study combinations). 

• Methodologically, the study has been criticized for selecting 
cases and controls from different hospitals; for excluding 
patients with adenocarcinoma and with alveolar carcinoma; 
for the lack of histological or cytological confirmation in 
35% of the cases; and for its small sample size. 8 ' 24 According 
to Uberla, the small sample size means that "the statistically 
•significant' results of this study may well be artefacts 
from chance, bias or confounding." 23 
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Copies of the articles referenced above, highlighted in 
yellow for useful information and in blue for adverse statements 
are found at Tabs 21-23. 
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